Improved Statistical Language Model for Context-sensitive Spelling Error Candidates
نویسندگان
چکیده
منابع مشابه
Context-sensitive statistical language modeling
We present context-sensitive dynamic classes – a novel mechanism for integrating contextual information from spoken dialogue into a class n-gram language model. We exploit the dialogue system’s information state to populate dynamic classes, thus percolating contextual constraints to the recognizer’s language model in real time. We describe a technique for training a language model incorporating...
متن کاملAn Improved Error Model for Noisy Channel Spelling Correction
The noisy channel model has been applied to a wide range of problems, including spelling correction. These models consist of two components: a source model and a channel model. Very little research has gone into improving the channel model for spelling correction. This paper describes a new channel model for spelling correction, based on generic string to string edits. Using this model gives si...
متن کاملApplying Winnow to Context-sensitive Spelling Correction Applying Winnow to Context-sensitive Spelling Correction
Multiplicative weight-updating algorithms such as Winnow have been studied extensively in the COLT literature, but only recently have people started to use them in applications. In this paper, we apply a Winnow-based algorithm to a task in natural language: context-sensitive spelling correction. This is the task of xing spelling errors that happen to result in valid words, such as substituting ...
متن کاملContext-Sensitive Statistics For Improved Grammatical Language Models
We develop a language model using probabilistic context-free grammars (PCFGs) that is “pseudo context-sensitive” in that the probability that a nonterminal N expands using a rule T depends on N’s parent. We give the equations for estimating the necessary probabilities using a variant of the inside-outside algorithm. We give experimental results showing that, beginning with a high-performance PC...
متن کاملContext-Sensitive Spelling Correction and Rich Morphology
Context-sensitive spelling correction is the task of correcting spelling errors which result in valid words. We present work in progress where we adapt established methods from English to a morphologically rich language and conclude that the rich morphology negatively affects performance. However, our system is still good enough to be useful in regular word processing.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Korea Multimedia Society
سال: 2017
ISSN: 1229-7771
DOI: 10.9717/kmms.2017.20.2.371